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Abstract 

We introduce a new technique called oblivious rounding — 
a variant of randomized rounding that avoids the bottleneck 
of first solving the linear program. Avoiding this bottle- 
neck yields more efficient algorithms and brings probabilistic 
methods to bear on a new class of problems. We give obliv- 
ious rounding algorithms that approximately solve general 
packing and covering problems, including a parallel algo- 
rithm to find sparse strategies for matrix games. 

1 Introduction 

Randomized Rounding: Randomized rounding 
]l8| is a probabilistic method [^0|, [l] for the design of 
approximation algorithms. Typically, one formulates 
an NP-hard problem as an integer linear program, dis- 
regards the integrality constraints, solves the resulting 
linear program, and randomly rounds each coordinate 
of the solution up or down with probability depending 
on the fractional part. One shows that, with non-zero 
probability, the rounded solution approximates the op- 
timal solution. This yields a randomized algorithm; in 
most cases it can be derandomized by the method of 
conditional probabilities $T\ . The probabilistic analy- 
ses are often simple, relying on just a few basic tech- 
niques. Yet for many NP-hard problems, randomized 
rounding yields the best approximation known by any 
polynomial time algorithm ^ . 

Oblivious Rounding: Derandomized or not, a 
main drawback of randomized rounding algorithms has 
been that they first solve a linear program to find a solu- 
tion to round. We show that this bottleneck can some- 
times be avoided as follows: (1) show that randomly 
rounding an optimal solution (possibly to smaller-than- 
integer units) yields an approximate solution; (2) ap- 
ply the method of conditional probabilities, finding pes- 
simistic estimators JlTj that are essentially independent 
of the optimal solution. The method of conditional 
probabilities is used not to derandomize per se, but to 
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achieve the independence. 

Generalized Packing and Covering: The re- 
sulting algorithms find the approximate solution with- 
out first computing the optimal solution. This allows 
randomized rounding to give simpler and more efficient 
algorithms and makes it applicable for integer and non- 
integer linear programming. To demonstrate this, we 
give approximation algorithms for general packing and 
covering problems corresponding to integer and non- 
integer linear programs of small width, including a paral- 
lel algorithm for finding sparse, near-optimal strategies 
for zero-sum games. 

Packing and covering problems have been exten- 
sively studied (see §^). For example, Plotkin, Shmoys, 
and Tardos fll6| approached these problems using 
Lagrangian-relaxation techniques directly. Their algo- 
rithms and ours share the following features: (1) they 
depend similarly on the width, (2) they are Lagrangian- 
relaxation algorithms, (3) they allow the packing or cov- 
ering set to be given by a (possibly approximate) sub- 
routine for optimizing over it, (4) they produce dual 
solutions that prove near-optimality, and (5) they can 
provide integer solutions comparable to those obtain- 
able by randomized rounding. Our approach shows a 
strong connection between probabilistic techniques and 
Lagrangian relaxation. Our algorithms are also rela- 
tively simple, although they are not as effective for some 
problems of large width. 

Flavor of Oblivious Rounding Algorithms: 
For the (integer) set cover problem, oblivious rounding 
yields the greedy set cover algorithm jl(^, [IJ] . For the 
fractional set cover problem, it yields an algorithm that 
repeatedly chooses a set whose elements have the largest 
net weight, where the weight of an element is initially 1 
and is multiplied by 1 — e each time a set containing it 
is chosen. To obtain the final cover, each set is assigned 
a weight proportional to the number of times it was 
chosen (this is similar in spirit to [Q and related works). 
For multicommodity flow, it yields algorithms that 
repeatedly augment flow along a shortest path, where 
the length of an edge is initially 1 and is multiplied by 
l+ec/c(e) each time the edge is used (c(e) is the capacity 
of the edge and c is the minimum edge capacity). 
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Problem Definitions: Let P be a convex set in 
E™ and let / be a linear function (not nec. homogenous) 
from P to K m . The width of P with respect to / is 
lu = maxj x fj[x) — L, where L = min^ -, x fj(x). 

The generalized packing problem is to compute A* = 
min^gpmaxj fj(x). The packing problem occurs when 
/ is non-negative on P. The covering problem is to 
compute A* = max xe p mux,- fj(x), assuming / is non- 
negative. (This is equivalent to the generalized packing 
problem with the restriction that / is non-positive.) 

Our algorithms assume an optimization oracle for 
P and / — given non- negative y € R m , the oracle 
returns x and f(x), where x minimizes ■ Vjfj(x). 
(This models, e.g., packing source-sink paths subject to 
edge constraints; in this case the oracle would compute 
a shortest path for given non-negative edge lengths.) 
For covering, the oracle must maximize the sum. 

Quality of Solutions: Given the oracle, n, m, 
lu, L, and e > 0, our algorithms return e-approximatc 
solutions. For generalized packing, e is the additive 
error with respect to A*. For packing and covering, the 
error is a factor of 1 ± e. 

Complexity: Table |l| shows the number of itera- 
tions required and the complexity per iteration. In that 
caption, "explicitly given" means that f(x) = Ax + b, 
where A and b are, respectively, an explicitly given ma- 
trix and vector, while P = {x G R™ : x > 0; Xi = 1}. 

Granularity: The oracle is called once in each 
iteration of the algorithm; the algorithm returns the 
average of the solutions returned by the oracle. Thus, 
the granularity of the final solution is the granularity 
of the solutions returned by the oracle, divided by the 
number of iterations. For the abstract problems we 
consider, this can provide integer solutions comparable 
to those obtainable by other techniques. 

Dual Solutions: Our algorithms maintain a dual 
solution, represented by a vector y, initially uniform. 
In each iteration, each yj is multiplied by a factor 
depending on fj(x) where x is the solution returned 
by the oracle (e.g., for packing, yj is multiplied by 
1 + efj(x)/ui). The average over all iterations of the 
values of these dual solutions is e-optimal with respect 
to the value of the final (primal) solution. 

Sparse Strategies for Zero-Sum Games: The 
explicitly given general packing problem generalizes the 
problem of finding near-optimal strategies for zero-sum 
matrix games: P is the set of mixed strategies for one 
player, fj(x) is the expected payoff if the player plays 
according to x and the opponent plays the pure strategy 
j, and A* is the value of the game. An approximate 
solution is a mixed strategy x guaranteeing an expected 
payoff within an additive e of optimal. 



generalized packing: 
packing: 
covering: 



lu 2 ln(m) 
(1 + ejeu ln(m) 



A*6(e) 
lu ln(m) 
X*b(-e) 

6(e) := (1 + e) ln(l + e) - e; 
6(- e )>4>6( £ ) >3 ^. 



Table 1: Number of iterations. Each iteration requires 
O(logm) time and 0(m) operations (on an EREW- 
PRAM), plus one oracle call. For an explicitly given 
problem (no oracle), each iteration requires O(lognm) 
time and O(nm) operations. 



Each iteration chooses the best pure strategy given 
that the opponent plays the mixed strategy represented 
by y. The final solution returned is a mixed strategy 
that plays uniformly from | - 2 1 <; " m l pure strategies, one 
for each iteration. (The opponent has m pure strategies; 
lu is the maximum minus the minimum payoff.) The 
existence of such sparse, near-optimal strategies was 
shown probabilistically |g[ our existence proof of 
the approximate solution for generalized packing is a 
generalization of the proof in |p_3|| . 

2 Related Work 

Plotkin, Shmoys, and Tardos |ll| (generalizing a series 
of works on multicommodity flow M, O, |l2|]) gave ap- 
proximation algorithms for general packing and covering 
problems similar to those we consider. For these ab- 
stract problems, their results are comparable to those 
in this paper, but for many problems their results are 
stronger. Most importantly, they give techniques for re- 
ducing the effective width of a linear program and tech- 
niques for problems (such as concurrent multicommod- 
ity flow) when the packing or covering set is a Cartesian 
product. 

Luby and Nisan Jl5[ give a parallel approximation 
algorithm for positive linear programming — the special 
cases of linear programming of the form max x {c • x : 
Ax < b; x > 0} (a packing problem), or the dual 
minj,{& ■ y : A T y > c; y > 0} (a covering problem), 
where A, b, and c have non-negative coefficients. Here 
A, b, and c are explicitly given. 

Previous algorithms applicable to zero-sum games 
either required the solution of a linear program || or 
did not provide sparse strategies |5[ |[ |l5|. 
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3 Introductory Example: Set Cover 

To introduce oblivious rounding, we give a simple 
example. The set cover problem is the following: 
given a family of sets T = {Si,...,S m }, with each 
Si C {1, 2, . . . ,n}, a set cover C is a sub-family such 
that every element j — 1, . . . , n is in some set in C. 
The problem is to find a cover C that is not much 
larger than C* , a minimum-cardinality cover. We derive 
an algorithm that, without knowing C* , emulates a 
random experiment that draws sets randomly from C* . 
The algorithm finds a cover of size at most \\C*\ Inn] . 

3.1 Existence: Let s = [~|C*| km] . Consider draw- 
ing s sets uniformly at random from C* . What is the 
expected number of elements left uncovered? For any 
given element x £ X, the probability that it is not 
covered in a given round is at most 1 — 1/|C*|, be- 
cause it is in at least one set in C* . Thus the ex- 
pected number of elements left uncovered is at most 
n(l - 1/|C*|) S < nexp(-s/\C*\) < 1. Thus, with non- 
zero probability we obtain a cover C of size s. 

3.2 Construction: The method of conditional prob- 
abilities naively applied to the above proof yields an 
algorithm that depends on C* . We outline this next. 
Our ultimate goal is not derandomization per se, but 
an algorithm that does not require knowledge of C*. 

Consider an algorithm that chooses the sets sequen- 
tially, making each choice deterministically to do "as 
well" as the corresponding random choice would. Specif- 
ically, the algorithm chooses each set to minimize the 
expected number of elements that would remain uncov- 
ered if the remaining sets were chosen randomly from 
C*. Letting C denote the collection of sets chosen so 
far, this expected number is 



(3.1) 



d>(C) 



E 

j^UC 



\C* 



-\o\ 



(We use x* to denote 1 if Si G C* and otherwise; we 
use UC to denote the union of sets in C.) $ is called 
a pessimistic estimator jL7|, because (a) it is an upper 
bound on the conditional probability of failure (in this 
case, by Markov's inequality), (b) it is initially less than 
1, and (c) each choice can be made without increasing 
it. (The latter property follows in this case because <E> 
is an expected value conditioned on the choices made so 
far.) These three properties imply the invariant that if 
the remaining s — \C\ sets were to be chosen randomly 
from C* , the probability of failure would be less than 
one. Consequently, when |C| = s, C is a cover. 



Achieving Obliviousness: Because an uncovered 
element that occurs in several sets in C* contributes less 
to <fr, the above algorithm depends on the number of 
times each element is covered by C* . This is counter- 
intuitive, in that the only aspect of C* used in the 
proof was J2saj x t/ 1^**1 < 1 _ 1 / 1 C* | - Replacing each 
corresponding term in $ yields 



(3.2) 



*(c) = E 



1 - 



1 



\C* 



-\c\ 



$ is a pessimistic estimator. More importantly, among 
collections of sets of the same size, 4> is uniformly pro- 
portional to the number of uncovered elements in the 
set. Thus, the algorithm that uses <I> instead of $ 
does not depend on C* , it simply chooses each set 
to minimize the number of elements remaining uncov- 
ered. Nonetheless, it is guaranteed to keep up with the 
random experiment, finding a cover within |~|£7*| Inn] 
steps. This is the greedy set cover algorithm, origi- 
nally analyzed non-probabilistically by Johnson |lC| ] and 
Lovasz Q. 

Versus fractional cover: If the cover C* is a 
fractional cover, the analyses of both algorithms carry 
over directly to show a Inn performance guarantee. 

What enables oblivious rounding? We call 
such algorithms oblivious rounding algorithms. What 
kinds of randomized rounding schemes admit them? 
The key property is that the proof bounds the probabil- 
ity of failure by the expected value of a sum of products 
and bounds the terms corresponding across products 
uniformly. To illustrate, here is the explicit proof that 
mim^(CU{Si}) < $(C) : 



s-\C\ 



> 



y (V^Vfi-- 

\ (7*1 I \ \r. 



C* 



(7*1 \ \n 



Muc)uSi 



C* 



s-|C|-l 



= E^H^U^i) 



c 

I 1 

> min$(CU{5i}). 

i 

The first inequality is obtained by "undoing" one step 
of the substitution that yielded $ from The standard 
argument then applies. We use this principle for each 
of our analyses. 
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4 Algorithm for Generalized Packing 

Fix an instance (P, f,L,u,e) of the generalized packing 
problem. We consider randomly rounding an optimal 
solution to obtain an e-approximate solution; we then 
derive the algorithm that finds such a solution. 

4.1 Existence: Let A* and £* be an optimal solution. 
Let S be a multiset obtained by repeatedly choosing 
random elements of P, where each random element is 
chosen from a distribution over P with n-dimensional 
mean x* . Let x be the average of the points in S. 

Lemma 4.1. The probability that x is not an e- 
approximate solution is less than m/exp \ 2 ' S l e 1 . 

Proof. Without loss of generality, assume L — and 
Lj = 1. Otherwise take f(x) <— ^ X ^~ L and e <— e/uo. 

The convexity of P ensures that x G P. For 
each j, = YlxeS fj( x )/\^\' which is the average 

of \S\ independent random variables in [0,1]. Since 
E[fj(x)] = fj(x*) < A*, by Hoeffding's bound 0, 
Pr[/i(S) > A* + e] is less than 1/ exp(2|S'|e 2 ). Since 
j ranges from 1 to m, the result follows. o 

4.2 Construction: As in the set cover example, 
our algorithm mimics the random experiment. Each 
round it adds an element to S to minimize a pessimistic 
estimator. This pessimistic estimator is implicit in the 
existence proof. To find it, we need the inequalities that 
prove (a simplified version of) Hoeffding's bound: 

Lemma 4.2. ([pj) Let X = J2 x i be the sum of s 
independent random variables in [0, 1], with E(-?Q) < fa 
and ^2 Mi = /•*■ Then Pr[X > + se] < 1/ exp(2se 2 ). 

Proof. Let a = e 4e 



1. 



Pr 



[: 



x,> 



M" 



Pr 



n 



(i 



(4.3) 



< E 



< 



< 



n (1 + n 

11 (1 

I 

n 



a )/*i+e 



> 1 



(1 + a)^«+ e 
1 + a fa 



(1 + a)^+ c 



The second step follows from (1 + a) z < 1 + az for 

< z < 1 and Markov's inequality. The last step uses 

1 + az < (1 + a) 2+e /e 2£2 for e > 0, a = e 4c - 1, and 
z > 0. o 



The proof of Lemma (4.1) bounds the probability of 
failure by a sum of probabilities, each of which is 
bounded by an expected value ( |4.3| ) in Hoeffding's proof. 
Thus (when L = and w = 1), the proof bounds the 
probability of failure by the expected value of 

\- tt l + afj(x) 

^ W (l + a) A *+ £ ' 

the expectation of which is less than m/ exp(2\S\e 2 ). 
The conditional expectation of the sum given T C S is 



1 + q/j (g) 



(1 + a) A *+ e 



1 



(l + a) 



\'+e 



where s is the desired size of S. To obtain the 
pessimistic estimator for the algorithm, replace each 
fj(x*) by the upper bound A*: 



E[n^ 



afj(x) 



(1 + a) x '+ e 



1 



(l + a) 



S -|T| 



When s is large enough that m/ exp(2|S'|e 2 ) < 1, this 
quantity is a pessimistic estimator: (a) it is an upper 
bound on the conditional probability of failure, (b) it 
is initially less than 1, and (c) some x can always be 
added to S without increasing it. Properties (a) and 
(b) follow from the choice of s and the inequalities in 
the proof of Hoeffding's lemma. Property (c) follows 
from the derivation, as explained for the set cover ex- 
ample. Among multisets of a given size, this pessimistic 
estimator is uniformly proportional to 

j xer 

Thus, to augment a given multiset T, the algorithm 
adds the element x minimizing • Vjfj(x), where t/j — 
TixeT l+ a fj( x )- This, accounting for the normalization 
L = and u> = 1, is the algorithm in Figure [l]. 

5 Packing and Covering Algorithms 

We derive the packing algorithm analogously. Fix an 



instance (P, /, w, e) of the packing problem 
x* , S and x be as for Lemma 4.1 



Let A*, 
Note that, for this 
problem, an e-approximate solution is an x S P with 
fix) < (l + e)A*. 



5.1 Existence: 

Lemma 5.1. The probability that x 
approximate solution is less than m/exp 



is not an e- 

~|S|fc(e)A* " 
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Find-Generalized-Packing(P, /, L, oj, e) 

1. e^±;a^e**-l;S^{};s^^ 

2- Vj <- 1 (j = l,...,m) 

3. repeat 

4. choose xefto minimize yjfj(x) 

5. S^SULx} 

6. % <- yj • [l + a h[x l~ L ] (J = 1, . . . , m) 

7. until |5| > s 

8. return ^J2 xe s x 



Find- Packing-Given- s (P. /, e, w, s) 
1. 

2 - yj <- 1 0' = l,-..,m) 

3. repeat 

4. choose iGfto minimize Y) j Ujfj(x) 

5. S«-SU{a:} 

6. Vj «- Vj ■ [1 + e^M] (j = l,...,m) 

7. until |5| > s 

8. return i^^es ^ 



Figure 1: Algorithm for generalized packing 



Proof. Without loss of generality, assume ui — 1. Oth- 
erwise take f(x) *— f(x)/u> and A* «— A*/w. 

The convexity of P ensures that x £ P. For each 

3, fj( x ) = Sxes/iW/l 5 '!' wnich is the average of 
\S\ independent random variables in [0,1], each with 
expectation fj(x*) < A*. By Raghavan's bound [p"7| , 
Pr[/i(5) > (l+e)A*] is less than l/exp[|5|6(e)A*]. Since 
j ranges from 1 to m, the result follows. o 

5.2 Construction: Here is Raghavan's proof: 

Lemma 5.2. (@) lei X = yjX* be the sum of 
independent random variables in [0, 1] with E(X) < fJ-i 
and yj f-i — M > 0. 

Then Pr[X > (1 + e)fi] < 1/ exp[6(e)/z]. 



Proof. 



Pr[X > (1 + e)/x] 



Pr 



(l + e) 



A', 



(5.4) 



< E 



(l + e)(i+«)^ 
1 + eX 4 



> 1 



(l + e )(l+e) W 



n l + eE(XQ 
(l +e )(l+e)Mi 



< 



(1 + e )(i+«)/*i 



The last line equals 1/ exp[b(e)/x]. The second step uses 
(l + a) z < 1 + az for < z < 1 and Markov's inequality. 
The last uses E(X) < m and 1 + z < e 2 , which is strict 
if z ^ 0. o 



Thus (assuming u; = 1), the proof of Lemma O bounds 
the probability of failure by the expectation of 

\ - TT l + 

2^ 11 Q + e )(l+e)A* 



Figure 2: Algorithm for packing, given s. To obtain 
covering algorithm, negate e and change "minimize" to 
"maximize" . 



corresponding to (5.4). The expectation given T C S is 



E 

3 



iitt 



1 + €/,■(*) 
(l + e )(l+e)A« 



(l + e)( 1 + £ ) A * 



|T| 



where s is the desired size of 5. When s is large enough 
that m/ exp[|5|6(e)A*] < 1, replacing fj(x*) by A* gives 
a pessimistic estimator. Among multisets T of the same 
size, the pessimistic estimator is proportional to 

^Hl + efjix). 
3 xer 

Thus, to augment a given multiset T, the algorithm 
adds the element x minimizing yV Ujfj(x), where yj = 
n^sT ^~\~ e fj( x )- This, accounting for the normalization 
to the case to = 1, gives the algorithm in Figure |2[ 
This algorithm assumes s is given. We remove this 
requirement in Section |(| 

5.3 Covering Algorithm. The covering algorithm 
is described in Figure ||. Its derivation is analogous 
to that of the packing algorithm. Fix an instance 
(P, /, w,e) of the approximate covering problem. Let 
A*, x*, S and x, be as for Lemma |4.l[ Note that, for 
this problem, A* = xnixij fj{x*) and an e-approximate 
solution x S P satisfies f(x) > (1 — e)A*. 

Lemma 5.3. The probability that x is not an e- 
approximate solution is less than m/ exp[\S\b(e)X* /lu]. 



We omit the proof, which is essentially the same as for 
packing, except it is based on the following variant of 
Raghavan's bound: 



Lemma 5.4. ([17]) Let X = J2 x i be the sum of 
independent random variables in [0,1] with E(Xj) > /Ltj 
and yj/ij = jJL > 0. 

Then Pr[A < (1 - e)fi] < 1/ exp[6(-e)/i]. 
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We omit the derivation of the algorithm, noting only 



that the proof of Lemma 5.3 implicitly bounds the 



probability of failure by the expectation of 



En 

3 x£S 



(1 - e )(i-^* 



6 Dual Solutions 

Our algorithms implicitly find good approximate solu- 
tions to the underlying dual linear programs. The ar- 
gument that the algorithm "keeps up" with the random 
rounding of an unknown optimal solution implicitly uses 
a dual solution to bound the optimal at each iteration. 
The value of the solution generated by the algorithm 
thus converges not only to the value of the optimum, 
but also to the average of the values of these dual solu- 
tions. The basic principle in each case is similar to that 
for set cover, which we give first for illustration. 

6.1 Set Cover Dual: The dual problem is to assign 
non-negative weights to the elements so that the net 
weight assigned to the elements in any set is at most 
one. The value of the dual solution is the net weight 
assigned. 

At the start of a given iteration, suppose r elements 
remain uncovered, and let d denote the largest number 
in any set in T . Then assigning each uncovered element 
a weight of 1/d yields a dual solution of value v = r/d. 

During the course of the algorithm, let v denote the 
harmonic mean of the dual solutions corresponding to 
the iterations so far. 

Lemma 6.1. The set cover algorithm maintains the 
invariant that the number of elements not covered by 
the current partial cover C is less than n/ exp(\C\/v). 

The proof is essentially the same as the proof that $ 
is a pessimistic estimator, except the values of the dual 
solutions take the place of \C*\. 

Proof. In an iteration where the dual solution has value 
r/d, the number of uncovered elements decreases from 
r to r — d = r(l — l/v) < re" 1 /". By induction on 
the iterations, the algorithm maintains the invariant 
that the number of uncovered elements is less than 
n/exp(^ £ l/w^) where vi is the value of the dual 
solution corresponding to the £th iteration and I ranges 
over the iterations so far. Note that v = |C|/^ o 

Before the last iteration at least one element is left, 
so at that point n/exp((fc — l)/v) > 1. Thus, 

Corollary 6.1. The harmonic mean of the values of 
the dual solutions over the first k—1 iterations is larger 
than £pi , where k is the size of the final cover. 



The maximum value is at least the arithmetic mean, 
which is at least the harmonic mean, so at least one of 
these simple dual solutions has value above t— -• 

^ In n 

6.2 Generalized Packing Dual: The vector y 
maintained by the generalized packing algorithm repre- 
sents a dual solution. At the start of a given iteration, 
the value of the dual solution associated with y is 

iain x£P '52 j y j f j (x) 



(6.5) 



(Since y > 0, a simple argument shows this is a lower 
bound on A* = min^gp maxj fj(x).) 

Notation: During the course of the algorithm, let 
x denote the current solution X^es X /\S\ represented 
by S. Let A denote maxj fj(x). Let v denote the average 
of the values of the dual solutions for the previous 
iterations. Let v(x,y) denote ^2jyjfj{x)/J2jVj- 

Lemma 6.2. The generalized packing algorithm main- 
tains the invariant 

(l + a )|S|(A-z)/u> < (l + a)l s l^- i )/"+ e )m/exp(2|5|e 2 ). 



Proof. WLOG, assume L = and u> = 1. We show 
that J^j Uj is & t least the left-hand side and at most the 
right-hand side. The first part follows from the same 
sequence of inequalities that was used in §4.2 to derive 



the (numerator of the) pessimistic estimator: 



(1 



\s\x 



< 



3 



(1 



\S\f 3 (x) 



EIK 1+t *) 



< 



En* 

3 xes 



afj{x). 



Since yj = Yixes ^ a fj( x )i the first part follows. 

For the second part, we first note the role of the 
dual solution in each iteration: given the current x 
and y, the iteration increases the quantity yj by a 
factor of 1 + av(x,y). (This follows from inspection 
of the algorithm and the definition of v(x,y).) Next 
we apply the sequence of inequalities that bounded 
the pessimistic estimator below 1 in § [L2[ By the 
last inequality in Hocff ding's bound (Lemma p~2] ), 1 + 
av(x,y) < (1 + a) v(x ^ +e /e^q>(2e 2 ). Let v £ denote the 
value of v(x,y) at the £th iteration (for 1 < £ < \S\). 
By induction on the iterations 

E% ^ m(l + a)£^+ e )/exp(2|S|e 2 ). 

3 

Since \S\v = ^2 e V£, this gives the result. o 



Randomized Rounding without Solving the Linear Program 



7 



Find-Packing (P, /, e, w) 

1- S <- {}; w «- 1 (j = 1, ...,m) 

2. repeat 



3. 


choose x *E P to minimize v = 




4. 


SU{x} 


5. 




..,m) 


G. 






7. 


f> «- [(|5| - + ^(aOl/ISI 


(j = 1, . . . ,m) 


8. 


A <— max 3 i*j 




9. 


until A < (1 + e)V 




10. 


return Exes^/I 5 ! 





Corollary 6.4. [ A "^""^ ] iterations of the cov- 

ering algorithm, A > (1 — e)v, that is, the primal and 
average dual values differ by at most a factor of I — e. 

The algorithm is described in Figure ||. 



Figure 3: Algorithm for packing. To obtain covering 
algorithm, negate e's and change each "max" to "min" , 
"minimize" to "maximize", and "<" to ">". 



COROLLARY 6.2. After [ "^"" J iterations of the gen- 
eralized packing algorithm, A < v+e. That is, the primal 
and average dual values differ by at most e. 

6.3 Packing Dual: The packing and covering algo- 
rithms also generate implicit dual solutions whose aver- 
age values converge to the primal value. Let A and v be 
defined as for the generalized packing dual. 

Lemma 6.3. The packing algorithm maintains the in- 
variant that 

( 1+e )|S|A/w < me e|S|s/^ 



We omit this and subsequent proofs in this section, since 



they are similar to that of Lemma 6.2. 

Corollary 6.3. After [ (1 +1 ) b "'" m l iterations of the 
packing algorithm, A < (1 + e)v. That is, the primal 
and average dual values differ by at most a factor of 
1 + e. 

Our final packing algorithm detects convergence by 
comparing the primal value to the best dual value so 
far. The algorithm is shown in Figure |§|. The algorithm 
maintains f(x) (in the variable F) instead of x. 

6.4 Covering Dual: 

Lemma 6.4. The covering algorithm maintains the in- 
variant that 

(1 _ e )|S|A/«< TOe -«|S|8/„ 
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7 Using an Approximate Oracle 

If the subroutine for computing min^gp Ujfj( x ) re ~ 
turns only an approximate minimizer x, our algorithms 
still work well. The degree of approximation (absolute 
and/or relative) of the subroutine carries over into the 
performance guarantee of the algorithm. For covering, 
it can also affect the convergence rate (and therefore the 
granularity) . 

We model the error by assuming that, given y, the 
oracle returns an x such that 



(7.6) 



v(x, y) < (1 + Si) mint>(a;, y) 

x£P 



where v(x,y) = V ; Vjfj{ x ) Y. , .'/.;• h > denotes the 
relative error and 82 > denotes the absolute error. We 
call this a (8\,82)-approximate oracle. (For covering, 
the notion of approximation is defined analogously.) 

In each iteration, y still represents a dual solution. 
Since x is only an approximate minimizer, the value of 
the dual solution is no longer v(x,y), but it is at least 



v(x,y)-8 2 
l+<5i 



Still using v to denote the average of the 
values of the dual solutions for the previous iterations, 
define v to be the average of the corresponding v{x, y)'s. 
Lemmas 3.2, 6.3, and 3.4 go through directly provided 



"5" is substituted for From the (modified) lemmas, 
by the same reasoning that gives the corollaries to those 
lemmas, together with the fact that v < (1 + 8i)v + 82, 
we get the following propositions. 

Proposition 7.1. Suppose the generalized packing al- 
gorithm uses a (61,62) -approximate oracle. After 

! " "' iterations, X < v + e < (1 + Si)v + 6 2 + e. 



2€ 2 



Proposition 7.2. Suppose the packing algorithm uses 
a (81, 62) -approximate oracle. After 



(l+e)w hi rn 



itera- 



tions, A < (1 + e)v < (1 + e)(l + 5i)v + (1 + e)8 2 . 
For covering, v > (1 — 8±)v — 82- 

Proposition 7.3. Suppose the covering algorithm uses 
a {8\, 82) -approximate oracle. After 

uj\nm 



[(1 - 8t)\* - 8 2 }b(-e) 
iterations, A > (1 — e)v > (1 — e)(l — 8i)v — (1 — e)^. 

These results hold for the algorithms without mod- 
ification. In particular, V in the packing algorithm in 
Figure |3| equals the best v(x,y) seen so far, which is at 
least v, so is guaranteed to be within a 1 + e factor of A 
within the required number of rounds. 



8 Integer Packing and Covering 

The packing and covering algorithms in Figure |^, as 
they stand, do not allow explicit control over the gran- 
ularity of the final solution. Because the number of 
iterations can be less than the upper bound, the algo- 
rithms only guarantee a lower bound on the granularity. 
Of course, the lower bound is the difficult part, so it is 
not surprising that exact control over the granularity 
can be obtained. In this section, we discuss briefly how 
to modify those algorithms to find, e.g., an integer so- 
lution. 

For simplicity, we consider a particular case of 
integer packing. Fix an instance of the packing problem 
(P,f,uj,e). Let A* and x* be an optimal solution. In 
addition, let V C P be the extreme points on the 
boundary of P (if P is a polytope, V is its vertex set). 
We assume that the oracle returns only elements of V. 
The integer packing problem is to compute a maximum 
cardinality multiset S CV such that Ylxes fj( x ) — 1- 

Note that, for any such S, \S\ < [1/X*\ because 
f(x) < 1/15*1, where x = X^eS x /\&\- A-n e- approximate 
integer solution is a set S such that \S\ > \_1/X*\ and 

Let S be a multiset obtained by repeatedly choosing 
random elements of V, where each random element is 
chosen from a distribution on V with mean x*. (Such 
distributions exist because P is the convex closure of 
V.) 

Lemma 8.1. When \S\ < 1/X* , 



Pr 



(3j) V fj(x) > 1 + e < m/exp[6(e)/w]. 



xes 



The proof is essentially the same as that of Lemma |5.l| , 
except l/\S\ replaces A*. 

A corollary to the lemma is that, provided 
m/ exp[b(e) / u] < 1, there exists an e-approximate inte- 
ger solution. The corresponding algorithm is the same 
as the basic packing algorithm, except the termination 
condition is different. The algorithm terminates when 
adding another element would cause ^2 xGS fj(%) > 1 + e 
for some j. Because the algorithm keeps up with 
the random process, the resulting set has size at least 
Ll/A*]. 

Complexity and Performance Guarantee: 

The algorithm is given in Figure ||. Note that [1/ A*J < 
15*1 < L(l + e )M*J: so the number of iterations in 
this case is at most (1 + e)/A*. For the condition 
m/exp[6(e)/tj] < 1, it suffices that, for instance, e > 
2 max(w mm, \fw mm). 

Covering: The same techniques apply for integer 
covering. For covering, define an e-approximate integer 
solution to be a set S such that |5| < [1/A*] and 
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Find-Integer- Packing (P, f, e, u) 
assumption: mj exp[b(e) / u>] < 1. 



1. 
2. 
3. 
4. 
5. 
G. 
7. 



S «-{};%•«- 1, ^ «-0 (i = l,...,m) 
repeat 

choose x £ P to minimize y\ - Ujfj(x) 
F, 



if maxj i^- 



Fj + fj(x) 0' = l,...,m) 
> 1 + e return S 1 
S«-Sru{a:} 
% <~ 2/3 



+ (7 = 1,. ...m) 



Figure 4: Algorithm for integer packing. To obtain 
covering algorithm, negate e's and change "max" to 
"min", "minimize" to "maximize", and ">" to "<". 

YlxeS fj( x ) — 1 — e - (Many variations are possible.) 
Let 5* be a random multiset as above. 

Lemma 8.2. When \S\ > 1/A*, 



Pr 



(3j) < 1 - e < m/exp\b(-e)/u]. 

x£S 



The resulting algorithm is described in Figure [|. The 
number of iterations in this case is at most [1/A*]. 
For the condition m/exp[6(— e)/oj] < 1, it suffices that 
e > \/2uj In rn. 

9 Conclusion 

Partial derandomization: The point of oblivious 
rounding is not derandomization per se, but to achieve 
independence from the unknown aspects of the optimal 
solution. For some random rounding schemes, some of 
the parameters of the random process are known; these 
can be left in the algorithm. For instance, in concur- 
rent multicommodity flow, the relative amount of flow 
of each commodity is known. A natural randomized 
rounding scheme is to choose a commodity with prob- 
ability proportional to its (known) demand, and then 
to choose a flow path among paths for that commodity 
with probability proportional to its (unknown) weight in 
the optimal flow. Applying oblivious rounding to only 
the second random choice gives a randomized algorithm 
in the style of @. 

Mixed bounds: Each of the random analyses in 
this paper employed a single type of probabilistic bound. 
This is not a limitation of the technique. Oblivious 
rounding can be applied to analyses using, e.g., sums of 
probabilities bounded by Raghavan's bounds, Hocffd- 
ing's bound, and Markov's inequality. This is relatively 
straightforward, if technically more tedious. 

More general functions: Chernoff-type bounds 
exist for more general classes of functions than linear 
functions (e.g., Azuma's inequality [0). A natural 



question is whether oblivious rounding can be applied 
to such bounds to optimize more general functions. 
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